Conditioning an Additive Functional of a Markov Chain to Stay Non-negative Ii: Hitting a High Level
نویسندگان
چکیده
Let (Xt)t≥0 be a continuous-time irreducible Markov chain on a finite statespace E, let v : E → R\{0} and let (φt)t≥0 be defined by φt = ∫ t 0 v(Xs)ds. We consider the cases where the process (φt)t≥0 is oscillating and where (φt)t≥0 has a negative drift. In each of the cases we condition the process (Xt, φt)t≥0 on the event that (φt)t≥0 hits level y before hitting zero and prove weak convergence of the conditioned process as y → ∞. In addition, we show the relation between conditioning the process (φt)t≥0 with a negative drift to oscillate and conditioning it to stay non-negative until large time, and relation between conditioning (φt)t≥0 with a negative drift to drift to drift to +∞ and conditioning it to hit large levels before hitting zero.
منابع مشابه
Conditioning an Additive Functional of a Markov Chain to Stay Non-negative I:survival for a Long Time
Let (Xt)t≥0 be a continuous-time irreducible Markov chain on a finite statespace E, let v be a map v : E → R\{0} and let (φt)t≥0 be an additive functional defined by φt = ∫ t 0 v(Xs)ds. We consider the cases where the process (φt)t≥0 is oscillating and where (φt)t≥0 has a negative drift. In each of the cases we condition the process (Xt, φt)t≥0 on the event that (φt)t≥0 stays non-negative until...
متن کاملMapping Activity Diagram to Petri Net: Application of Markov Theory for Analyzing Non-Functional Parameters
The quality of an architectural design of a software system has a great influence on achieving non-functional requirements of a system. A regular software development project is often influenced by non-functional factors such as the customers' expectations about the performance and reliability of the software as well as the reduction of underlying risks. The evaluation of non-functional paramet...
متن کاملConditioned, quasi-stationary, restricted measures and escape from metastable states
We study the asymptotic hitting time τ (n) of a family of Markov processes X to a target set G when the process starts from a trap defined by very general properties. We give an explicit description of the law of X conditioned to stay within the trap, and from this we deduce the exponential distribution of τ . Our approach is very broad —it does not require reversibility, the target G does not ...
متن کاملLimit Theorems for subgeometric Markov chains
This paper studies limit theorems for Markov Chains with general state space under conditions which imply subgeometric ergodicity. We obtain a central limit theorem and moderate deviation principles for additive not necessarily bounded functional of the Markov chains under drift and minorization conditions which are weaker than the Foster-Lyapunov conditions. The regeneration-split chain method...
متن کاملSkip-free Random Walks with Markovian Increments
Let (ξk, k ≥ 0) be a Markov chain on {−1, +1} with ξ0 = 1 and transition probabilities P (ξk+1 = 1| ξk = 1) = a and P (ξk+1 = −1| ξk = −1) = b < a. Set X0 = 0, Xn = ξ1 + · · ·+ ξn and Mn = max0≤k≤n Xk. We prove that the process 2M − X has the same law as that of X conditioned to stay non-negative. Pitman’s representation theorem [19] states that, if (Xt, t ≥ 0) is a standard Brownian motion and...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2005